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Amendments to the Claims: 



This listing of claims will replace all prior versions/ . and 

I 
i 

I 



listings, of claims in the application: ! 



Listing of Claims : 

1-51- (Canceled) 



J" ^ 52. (Currently amended) In a video hyperlinked annotation 
data system, a computer-readable medium storing data for access 



by an application program executed by a processor in 



the 



hyperlinked annotation data system, the computer-readable meldium 
comprising: ! 

a . first annotation data structure element including an 



/ Is ! 

object reference for an object in a video fracie an<3 a 



^y.^' corresponding first identifier; [ [and] ]^j>\vr<Jl ^oj^c^^ 

a second annotation data structure element identif ie<^ by 
said first identifier, said second annotation data structure 



element including a first set of annotation [data 



references 

[[.]]; ^ccr* 



A 



a sixth data structure element storing image overlay data, 
\t> the object being visually identified /based on the stored iirciage 



overlay data in response t^auser command^ and t**"^* 
at least one timing data indicator stored in associaltion 



with at least one of the plurality of data structure elements 



wherein the application program retrieves the stored timing 



data indicator and synchronizes presentation of at least onfe of 
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i 

j 

the plurality of data structure elements with a video flrame 

I 

based on the retrieved timing data indicator. ! 



53. (Canceled) 

54. (Previously Presented) The system of claim 53 wherein 
said timing data indicator indicates an expiration time* 

55. (Previously Presented) The system of claim 53 wherein 
said timing data indicator indicates an activation time. 



56, 



(Previously Presented) The system of claim 52 wherein 



with 
sond 



i 



said first annotation data structure element is associated 
a set of video frames of a video program and wherein said se 
annotation data structure element is associated with said video 
program. 

i 

i 

57. (Previously Presented) The system of claim 52 wherein 
said first data structure element and said second data structure 
element are transmitted separately. 



58. (Previously Presented) The system of claim 52 wherein 

i 

said first set of annotation data references includes! an 
annotation data field and a second identifier referencing a 
third annotation data structure element. 



59. (Previously Presented) The system according to c 
58 wherein said annotation data field is a title data field 



.aim 
and 



-3- 
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said third annotation data structure element is a 
including a title of said object, 



string 



60. (Previously Presented) The system according to qlaim 
58 wherein said third annotation data structure element includes 
at least one display identifier for referencing a fourth data 
structure element to be displayed to a viewer and at least one 
action identifier referencing a fifth data structure element 
providing instructions so said system for action to be takep by 
said system. 

61. (Previously Presented) The system according to claim 
58 wherein said annotation data field is a variable parameter 
field. 

62. (Previously Presented) The system according to claim 
58 wherein said second identifier is a variable value. 

63. (Previously Presented) The system according to cllaim 
58 wherein said first and second identifiers are n,ever 
duplicated by the system. 



64. (Currently amended) The system according to claim 52 
wherein the sixth [further comprising a fifth] data structure 
element includes [including] location and shape information 
about said object. 



_ 4 _ 
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65. (Currently amended) The system according to claim 64, 
wherein said sixth [fifth] data structure element is associated 
with a video frame . 

66. (Currently amended) A method for generating one 
or more data structures via a first processor in a hyperlinked 
video signal annotation data system, the one or more data 
structures being stored in a computer-readable medium for access 
by an application program executed by a second processor in the 
hyperlinked video signal annotation data system, the method 
comprising: 

creating a first annotation data structure elenent 
including an object reference for an object in a video frame and 
a corresponding first identifier; [[and]] 

creating a second annotation data structure element 
identified by said first identifier, said second annotation data 
structure element including a first set of annotation eiata 
references [[.]]_£. 

Creating a sixth data structure element storing inaqe 



overlay data, the object being visually identified based on | the 
stored image overlay data in response to a user command; and j 

Creating at least one timing data indicator _in association 

with at least one of the plurality of data structure elements,,' 

Wherein the application program retrieves the timing olata 

indicator and synchronizes presentation of at least one of !the 
plurality of data structure elements with a video frame basecj on 
the retrieved timing data Indicator . 
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67. (Canceled) 



68. (Previously Presented) The method of claim \ 67 
wherein said timing data indicator^indicates an expiration time- 

69. (Previously Presented) The method of claim | 67 
wherein said timing data indicator indicates an activation time. 



70. (Previously Presented) The method of claim 



66 



wherein said first annotation data structure element j is 

i 

associated with a set of video frames of a video program and 

i 

wherein said second annotation data structure element is 

i 

associated with said video program. ! 



71. (Previously Presented) The method of claim 66 
wherein said first data structure element and said second &ata 
structure element are transmitted separately. 

| 

72. (Previously Presented) The method of claim 66 
wherein said first set of annotation data references includes an 
annotation data field and a second identifier ref erencinjg a 
third annotation data structure element. 

73. (Previously Presented) The method according to claim 
72 wherein said annotation data field is a title data field and 
said third annotation data structure element is a stting 
including a title of said object. 
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74. (Previously Presented) The method according to claim 
72 wherein said third annotation data structure element includes 
at least one display identifier for referencing a fourth data 
structure element to be displayed to a viewer and at least one 
action identifier referencing a fifth data structure elehient 
providing instructions to said system for actions to be taken by 
said system. 

75. (Previously Presented) The system according to cjlaim 
72 wherein said annotation data field is a variable parameter 
field. 

76. (Previously Presented) The method according to claim 
72 wherein said second identifier is a variable value. 



77. (Previously Presented) The system according to 
72 wherein said first and second identifiers are 
duplicated by the system. 



cl 



I. aim 
r 



neve 



78. (Currently amended) The system according to claim 66 



[further comprising] wherein the sixth [creating a fifth] 
structure element includes [including] location and 
information about said object. 



data 
shape 



79. (Currently amended) The system according to claim! 78, 
wherein said sixth [fifth] data structure element is associated 

i 

with a video frame. 
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80 . (Canceled) 



81. (Currently amended) The computer-readable medium 



of 
with 



claim 80, wherein [the image overlay data is associated 
first timing data,] presentation of the image overlay is [fc^ing] 
synchronized with the video frame based on the [first] tijming 
data indicator. I 



82, 



(Currently amended) The computer-readable medium 



of 



claim 81, wherein a computer program code compares the [first] 
timing data indicator with second timing data associated with a 
current video frame and sleeps for a period of time equivalent 
to a difference in times indicated by the first and second 
timing data, the computer program code being awakened j for 
visually identifying the object based on the image overlay (data 

in response to an expiration of the time period. i 

i 

! 
I 
I 

83. (Previously Presented) The computer-readable medium 

of claim 81, wherein at least one of the data structurejs is 

i 

associated with second timing data, the second timing data being 
indicative of a last instance the data structure is used !in a 
video program associated with the video frame, wherein the jdata 

structure is removed from the computer-readable medium in 

i 

response to a determination based on the second timing data j that 
the data structure is no longer used in the video program . 



84-94 



(Canceled 



-8- 



PAGE 9/11 * RCVDAT 9/14/2004 1:49:01 PM [Eastern Daylight Time]* SVR:l)SPTO-EFXRF-2/2 * DNIS:7465748 * CSID:626 577 8800 1 DURATION (mm-ss):03-12 



09/14/2004 10:50 FAX 626 577 



CHRISTIE PARKER 4 



0010 



Appln No, 09/697,775 

Amdt date September 14, 2004 

Reply to Office action of July 21, 2004 



95, 



(Currently amended) A method for generating one or 



more data structures via 



first processor in a vkd 



eo 



hyperlinked video signal annotation data system, the one or more 

data structures being stored in a computer-readable medium for 

access by an application program executed by a second processor 

in the hyperlinked video signal annotation data system, the 

i 

method comprising: 

identifying a region of a video frame associated with an 
object included in the video frame; 

selecting a value for the identified region; 

creating a first data structure mapping the selected v^lue 
to a plurality of pixels in the identified region, the first 
data structure further storing a first reference pointer; 

creating a second data structure identified by the first 
reference pointer, the second data structure associating the 
value to a first identifier; and 

creating a third data structure identified by the first 
identifier, the third data structure including a first set of 
annotation data references for the object [[.]]> 



wherein the application program presents at le,st one of 



the 



data structures in a manner that is synchronized with a video 



frame . 



96, (Previously Presented) The method of claim 95, 
wherein the value is associated with image overlay data ! for 
visually identifying the object in response to a user command. 
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97, (Previously Presented) The method of claim 
wherein the first data structure is associated with first 
data., the method further comprising processing the first 
data and synchronizing presentation of the image overlay 
the video frame based on the processed first timing data. 



96, 
timing 
timing 



with 



of 



claim 



97 



98. (Previously Presented) The method 
further comprising : 

comparing the first timing data with second timing 
associated with a current video frame; 

causing a computer program code to sleep for a period of 
time equivalent to a difference in times indicated by the f 
and second timing data; and 

awakening the computer program code for visually 
identifying the object based on the image overlay data 
response to an expiration of the time period. 



lata 



Lrst 



in 



99. (Previously Presented) The method of claim 98, 
wherein at least one of the data structures is associated with 
second timing data, the second timing data being indicative of a 
last instance the data structure is used in a video program 
associated with the video frame, the method further comprising: 

removing the data structure from the computer-readable 
medium in response to a determination based on the second timing 
data that the data structure is no longer used in the video 
program. 



100-110 . (Canceled 
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